Event-LSTM: An Unsupervised and Asynchronous Learning-Based Representation for Event-Based Data
نویسندگان
چکیده
Event cameras are activity-driven bio-inspired vision sensors that respond asynchronously to intensity changes resulting in sparse data known as events. It has potential advantages over conventional cameras, such high temporal resolution, low latency, and power consumption. Given the asynchronous spatio-temporal nature of data, event processing is predominantly solved by transforming events into a $2D$ spatial grid representation applying standard pipelines. In this work, we propose an auto-encoder architecture named Event-LSTM generate representation. Ours following main 1) Unsupervised, task-agnostic learning grid. ideally suited for domain, where task-specific labeled scarce, 2) Asynchronous sampling This leads speed invariant energy-efficient Evaluations on appearance-based motion-based tasks demonstrate our approach yields improvement state-of-the-art techniques while providing flexibility learn from unlabelled data.
منابع مشابه
Spatiotemporal features for asynchronous event-based data
Bio-inspired asynchronous event-based vision sensors are currently introducing a paradigm shift in visual information processing. These new sensors rely on a stimulus-driven principle of light acquisition similar to biological retinas. They are event-driven and fully asynchronous, thereby reducing redundancy and encoding exact times of input signal changes, leading to a very precise temporal re...
متن کاملAn Unsupervised Learning based Approach for Unexpected Event Detection
This paper presents a generic unsupervised learning based solution to unexpected event detection from a static uncalibrated camera. The system can be represented into a probabilistic framework in which the detection is achieved by a likelihood based decision. We propose an original method to approximate the likelihood function using a sparse vector machine based model. This model is then used t...
متن کاملRepresentation Learning using Event-based STDP
Although representation learning methods developed within the framework of traditional neural networks are relatively mature, developing a spiking representation model remains a challenging problem. This paper proposes an event-based method to train a feedforward spiking neural network (SNN) for extracting visual features. The method introduces a novel spike-timing-dependent plasticity (STDP) r...
متن کاملAn Event Based Approach To Situational Representation
Many application domains require representing interrelated real-world activities and/or evolving physical phenomena. In the crisis response domain, for instance, one may be interested in representing the state of the unfolding crisis (e.g., forest fire), the progress of the response activities such as evacuation and traffic control, and the state of the crisis site(s). Such a situation represen...
متن کاملEvent-Based Tone Mapping for Asynchronous Time-Based Image Sensor
The asynchronous time-based neuromorphic image sensor ATIS is an array of autonomously operating pixels able to encode luminance information with an exceptionally high dynamic range (>143 dB). This paper introduces an event-based methodology to display data from this type of event-based imagers, taking into account the large dynamic range and high temporal accuracy that go beyond available main...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE robotics and automation letters
سال: 2022
ISSN: ['2377-3766']
DOI: https://doi.org/10.1109/lra.2022.3151426